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The  main  problem  to  be  solved  here  may  be  described  as  follows: 
let  X^,Xg, be  independent  random  variables,  each  with  density 
fg(x)  "  ^  over  (0,6)  and  zero  elsewhere.  It  is  desired  to  estimate 
the  unknown  parameter  6  by  an  interval  of  length  at  most  d  units 
and  vith  confidence  at  least  1-a,  for  some  specified  d  >  0  and 
a  in  (0,l) .  An  exact  solution  and  an  asymptotic  theory  for  a  sequential 
procedure  are  given  in  sections  1  and  2,  respectively. 

The  procedure  proposed  in  this  paper  is  optimal  in  the  sense 
that  the  expected  number  of  observations  is  minimized.  It  is  also 
minimax  in  that  the  maximum  possible  number  of  observations  is  minimized. 

1.  The  Procedure. 

By  an  estimation  rule  5,  we  understand  the  specification  of  a 
stopping  rule,  which  for  given  X^,X2, ...  determines  the  number  N  of 
observations  to  be  made,  together  with  a  function  which  we  also  denote 
by  b,  mapping  the  possible  . . .  ,X^)  into  sets  of  possible 

values  of  6.  Associated  with  a  particular  5  is  a  function 
?(0)  -  P^(f»€6(X^,X2,...)j  which  is  the  probability  that  6(X^,X2,...) 
contains  0  in  the  sequel  to  be  called  the  confidence  function. 

For  the  problem  to  be  solved  here,  without  loss  of  generality  we 

xi 

may  suppose  d  =  1,  since  for  any  other  positive  d,  —  is  uniformly 


1 


0 

distributed  over  (0,  ^).  Hence  we  may  consider  the  problem  as  one  of 
estimating  j  by  an  interval  of  at  most  unit  length. 

The  sets  we  shall  use  to  estimate  9  are  intervals  of  the  form 

A  A  A 

6(X1,X2, . .  .,XN)  =  (XN>g(XJJ)],  where  X^  denotes  the  maximum  of 
X^,X2, . . .  ,X^.  Clearly,  5  maps  the  sample  space  into  intervals  of 
length  <  1  unit  on  (0,0+1)  if  XN  <  g(XN)  <  XN+1.  Our  confidence 
requirement  is  7(0)  =  P^fX^.  <  9  <  g(XN)l  >  1-&  for  all  6.  Since 
XN  is  sufficient  for  9  in  the  fixed  sample  size  case,  (N,Xn)  is 
sufficient  for  9  in  the  sequential  case.  (See  Lehmann  [3],  p.  3*32.) 

A  /V 

But  N  is  a  function  of  X*T,  so  X.T  alone  is  sufficient  for  9  . 

N  N 

The  sequential  procedure  we  shall  adopt  is  as  follows: 

(1)  Observe  X, ,X0, ...  until  for  the  first  time  X„  <  a>T  , 

Id  N  —  N 

where  a^,a2, ■ *  *  form  a  non-decreasing  sequence  of  non-negative  real 
numbers . 

A 

(2)  If  this  occurs  at  N  =  n,  make  the  statement  'XR  <  9  <  g(Xn)' 

The  confidence  function  associated  with  this  statement  will  be  at  least 
1-a  for  every  9  for  an  appropriately  chosen  sequence  (a  ]  . 

O 

The  stopping  sets  for  this  procedure  are  determined  by  the 

sequence  [a.}.  Clearly,  the  stopping  set,  S  ,  of  points 
j  n 

(X^,X2, . . .  ,XR)  at  which  sampling  stops  at  N  =  n,  and  the  continuation 
set,  Ck  the  complement  of  S  in  n-dimensional  Cartesian  space, 
may  be  determined  successively  for  n  =  1,2,...  by  =  (0,a]  and 
the  recurrence  relation  Sn  =  (C^fl  (0,an]n’1)x(0,an) .  Thus  we  find 
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s2  -  (a1,a2Jx(0,a2],  =  (a^a^xCa^a^MO^j  U  (a2,a5]x(0,a5 ]x(0,a^j 

etc . 

We  will  now  determine  the  distribution  function  of  X„.  On  the 

N 

basis  of  our  sampling  procedure,  for  6  >  a  we  have 

—  n 


Pe(N=n)  =  Pe{(X1,X2,...,Xn)eSn 


1  f  f 

‘  J'y'J  dxidV",'dxn 


e 

n 

b 

=  —  ,  for  some  b 

en 


n-l  b 


For 


an-l  <  6  <  an  '  p0(N=n)  =  1“P0(N  <  n“1)  =  1  -  L  •  Define 


b  -  0.  Thus, 
o  ' 


L 

r=0  e 


PjN=n)  = 


/  0  ,  e  <  a 


-  n-l 


n-l  b 

1-7  —  ,  a  ,  <  3  <  a 

r=l  6r  H'1 


“  f  3  >  a 
6  n 


(1.1) 


n  b 

For  6  =  a  ,  p„(N  <  n,  #  T  —  -  1. 
n  $  —  nr 

r=l  e 


Hence 


,  n  ,  n-l  ,  n-2 

b  =  a  -b  a  -b0a 
n  n  1  n  2  n 


-  VlV  n  -  h-2’ 


(1.2) 


We  will  denote  by  Bn(x)  the  polynomial  obtained  by  replacing  a^ 


5 


in  the  right  hand  side  of  (1.2)  by  x;  i.e., 


/  \  n  n-1  n-2 

3n(x)  =  x  -blx  -b2x  . b  x  . 


Thus,  we  infer,  for  a  <  x  <  a  and  x  <  0,  P  (X  <  x,N=n) 

n-i  *  n  q  n  — 

A 

Now  PC(X  <  x|N=n)  =  1,  for  x  >  a  .  Hence 
6  n  —  —  n 


(1.3) 


V*) 


PA  <  *)  =  I  Pe(Xr  <  x,  N=r) 


v(j)-l 

VN=r)  +  VXv(x)  <^”  =  v(x)}  , 


where 


v (x )  =  ,}  if  a  <  x  <  a  . 

J  "1  ”  J 


It  follows  that  for  ali  x  in  (a^  ^,8^]  and  x  < 


■(xn  5 x)  =  I  i 


-lb  B  (x) 

+  -i— 


r=l  e 


e 


(1-4) 


For  x  >  $  each  side  of  this  equation  equals  1. 

Clearly,  y(6)  is  the  maximum  number  of  observations  which  could 
be  required;  i.e.,  v(e)  =  max  N,  the  largest  n  for  which  P  (N=n)  >  0 
Consider  now  procedures  with  terminal  statement  'X^  <  0  <  XN+1.' 
Using  (1.4),  the  probability  that  this  statement  is  untrue  is  given  by 


a(e)  =  p0(xM  <  e-i) 


n-1 


I 

r=l 


B  (e-i) 

n  7 


a  ,  <  0-1  <  a 
n-1  -  n 

(1.5) 


Hence  the  requirement  y(e)  >  1-a  is  equivalent  to  a(e)  <  a  for  all  0 


U 


The  optimality  criterion  ve  shall  adopt  is  as  follows:  of  all 
procedures  for  which  a(0)  <  a  for  all  0,  a  procedure  is  optimal  if 
every  other  procedure  with  smaller  v-function  for  some  0  has  larger 
V -function  for  at  least  one  O'  <6.  The  solution  to  be  investigated 
will  easily  be  seen  to  also  satisfy  an  optimality  criterion  of  the  same 
form  expressed  in  terms  of  the  expected  number  of  observations  rather 
than  the  v-function. 

Consider  the  case  0  <  0- 1  <  a^.  Using  (1.5)  and  (1.3)  we  have 
0-1 

a(9)  =  ~~ZTi  which  we  require  to  be  less  than  or  equal  to  «.  Hence 

aa 

a  must  be  such  that  — —  <  a*  Suppose  — --  =  a  .  Let  P  and  P* 

a.  a^+i  —  a^+i 

be  procedures  associated  with  a^  and  a*  and  with  v-functions  v(0) 

and  v(0)*,  respectively.  If  we  put  a^  =  a*  we  have  v(0)  ~  1  for 

0  in  (0,a*].  Suppose  we  choose  a^  <  a*.  Then  the  procedure  P 

cannot  be  optimal,  since  for  any  procedure  Pr  associated  with  a^  in 

(al,aj3,  v(u)'  <  v(Q)  for  0  in  (a^a^j,  but  v(^)'  is  not  greater 

than  v ( 0)  for  any  0  <  a^.  Since  this  is  true  for  any  a^  <  a*  and 

in  (a^,aj],  P  cannot  be  optimal  for  a^  <  a*.  Hence  we  put 

al  =  al;  we  choosc  a2  as  large  as  possible.  From  (1.2), 

b^  =  a^.  In  general,  because  of  our  optimality  criterion,  for  each  n 


we  choose  a  as 
n 

large  as 

possible:  i.e.,  a 

n 

is  the  largest  x 

for 

which 

n-1 

r-» 

b 

r 

n  ,  n-1  ,  n-2 

x  -b^x  -b2x 

•  •  •  *-b  _x 
n-1 

(i.e) 

L 

r=l 

(x+l)r 

(x+l)n 

-  CL 

i 


and  b  is  determined  using  (1.2).  It  should  be  noticed  that  a^,  -  a, 
n  2  1 

i.e.,  N  cannot  take  the  value  2  and  so  the  procedure  must  be 
started  by  taking  one  observation  and  if  the  observed  >  a^,  an 

additional  two  observations.  The  second  decision  whether  or  not  to 

A 

continue  sampling  is  then  based  on  the  observed  value  of  X^. 

Values  (correct  to  4  significant  figures)  of  the  first  20 

members  of  the  sequence  {a . }  are  given  in  table  1  for  a  =  0.05  and 

J 

0.01.  Members  of  the  sequence  {b , }  are  required  for  evaluating  the 

J 

expected  number  of  observations,  hereafter  to  be  denoted  by  E-.(N). 

y 

However,  in  section  2  we  will  derive  asymptotic  expansions  for  this 

function  which  are  independent  of  the  higher  members  of  the  sequence 

(b.j.  Thus  (in  table  2)  we  only  tabulate  (correct  to  4  significant 
J 

figures)  the  first  10  members  of  this  sequence  for  the  above  values 
of  a. 

n-1  br  Bn(x) 

From  (l.o)  we  have  V  -  +  -  <  a  for  x  in  (a  ,  ,a  ) 

r=l  (x+1)  (x+1) 

Hence  a(0)  <  a  for  6  in  the  intervals  (a^  ^+l,an+l),  n=l,2, 
where  a^  is  defined  to  be  zero.  However,  for  these  values  of  0,  the 
confidence  will  equal  1-a  if  we  slightly  modify  the  procedure  and 

A  A 

estimate  f  by  an  interval  of  the  form  (X^,g(X^)],  where 

g(XN)-XTJ  <  1.  Clearly,  we  require  P0ig(XN)  <  0}  =  P6{XN  <  g-1(0)}  =  a 

There  will  exist  a  value  x(a,6)  of  x,  depending  on  a  and  0, 

lor  which  P0(X^.  <  x)  -  a .  Hence  g  (e)  =  x(a,0).  For  the  optimal 

procedure  v(g)  cannot  take  the  value  2.  Suppose  v(@)  =  n,  n  4  2. 

„  n-1  br  Bn(x) 

Then  P  (XM  <  x)  -  J  — -  +  — - —  .  Thus  the  largest  root  of  the 
r~l  Gr  0 
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polynomial  atf  -lyi1  tJ“  -•••-b  ,,0-B  (x)  -  0  when  x  is  replaced 

x  d  n-j.  n 

a  /\ 

by  the  observed  value  of  X  is  the  required  value  of  g(X  ),  for 

n  n 

a  specified  a,  Clearly,  g(a  )  -  a  +1  since  a(a  +l)  =.-  a  for 

n  n  n 

n —1 , 2 , . « t  j 

Using  (l.l),  for  B  in  the  interval  (a^  ^,a  ],  the  expected 
sample  si2e  :\s  given  by 


n-1 

Ee(N)  -  I 
r-1 


n(l 


n-1 


1 

r-1 


n-1 


I 

r=l 


(n-r) 


U 

r 


(1.7) 


As  a  variation  of  the  procedure  already  described,  we  may  consider 

taking  observations  in  groups  of  m,  m  >  1.  Let  denote  the  n-th 

n 

member  of  the  sequence  which  determines  the  optimal  procedure  (i.e., 

the  sequence  in  which  members  are  chosen  successively  as  large  as 

possible).  Thus  we  have  0  -  a|m^  -  aji.m)  =  •••  =  a^m]  <  =  a^m^  =••• 

12  m-1  ia  m+1 

=  a2m-i  a2m^  =  01*  *  13  ^  =  for  J  noXj  8  multiple  of  m  and 

0  <  b^  <  b^m^  <  * J  *  ,  where  [bfm^]  is  the  sequence  determined  by 

m  dm  j 

(m) 

{a.  using  (1.2),  Also,  using  (1.7),  for  n  a  multiple  of  m,  say 
J 

.  /  (m)  (mK 

n  %  zm,  and  6  m  (a  ,  a  7  we  have 

n-rrr  n 


z-1 

y 

(n-rm)b^ 

rm 

z-1  rmb^ 
t"  n-rm 

L 

r-1 

* n '  k 

(1.8) 


2.  Asymptotic  Theory. 

Before  embarking  on  the  asymptotic  theory  we  will  consider  some 
sequences  of  numbers  which  will  prove  to  be  useful.  From  the  binomial 
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theorem,  for  m  a  non- negative  integer  we  have 


00 

y 

ml 


(m)  r-m 
r  x 


/.  N-(m+l)  (m)  rl 

1-x)  ,  where  r  =  — r  . 

ml 


r=0 


It  follows  that 


(pi)  r  mix 


m 


r  'x  = 


r=0 


(1-x) 


m+1 


(2.1) 


For  positive  integral  powers  we  have 


m 


r  =  £  S(m,s)r 
s=0 


(•) 


(2.2) 


where  the  numbers  {S(m,s)],  m  >  s,  are  the  Stirling  numbers  of  the 
second  Find.  These  numbers  are  tabulated  in  Table  XXII  of  Fisher  and 
Yates  [1]  under  the  title  'Initial  Differences  of  Pbwers  of  Natural 
Numbers , ' 

We  now  define  a  sequence  of  numbers  [p.],  vhere 

0 


p  ~  C-  r  e  ,  m-0,1,2, . . . 


r-0 


(2.3) 


Thus,  using  (2.2)  and  (2,1),  with  x  =.  —  ,  we  have 


m 


(s)  -r  _  5  S(m,s)sle 


I-V  =  X  3(»,b)  £  r'S  e~r  ~  l  . 

s  0  r=0  s=0  (e-1) 


,et  q_  -  —  .  Thus 
Tn  p 


m 


r  ^(m,s)sl  „  ^ 

=  1  c  ,  m=l,2,... 

m  st0  (e-l)s 


(2.4) 
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.  Later  members  of 


1  I  o ' 

In  particular,  q  -  — -  and  qQ  =  — -  -+  - 

e_1  "  e_1  (e-1)2 

sequence  (q  }  may  readily  be  evaluated  using  the  Fisher  and  Yates 
J 

i.able , 

net  us  assume  that  a^  and  b^  have  power  series  expansions  of 
the  following  forms; 


n 


(2.5) 


(2.6) 


where  c,k  and  the  members  of  the  sequences  of  coefficients  {d  .  ]  and 

J 

(e.)  are  constants, 

•J 

We  are  assuming  that  a^  asymptotically  approaches  the  linear 

function  j  (n+d^)  of  n.  If  a^  increases  approximately  as  ^ 

for  n  large,  b  =  an-bnan_1-b0an-2 
n  n  1  n  2  n 


n  b  k  b  k" 
m  l  \  ,  -  1  2 

k'  '  ’  n  2 

n 


n 

n-1 


b  a 
n-1  n 


b  k 

n-1  v  , 

- — )  .  Thus,  under  the  assumption 

n 


that  --  is  small  compered  with  p  if  seems  reasonable  to  assume 

the  expansion  (2.6)  for  b  , 

n 


We  will  now  find  expressions  for  the  constants  c,  k,  d  ,  d^  a 


nd 


The  equations  1.2)  and  (1.6)  which  determine  a^  and  b^  nay  be 


written 


n-1  b 


r*  n-r 
*-  n-r 


r=0  a 


=  1 


(2.7) 


9 


=  a 


(2.8) 


n-l  b 
Y  n-r 

r=0  (an+l)n_r 

Formally  substituting  the  power  series  expansions  for  and  b^ 

into  (2,7)  and  (2.8)  and  equating  coefficients  of  powers  of  n  leads  to 

equations  which  may  be  solved  in  succession.  Coefficients  of  terms  of 

_3  n-l 

higher  order  than  involve  series  £  rme‘r,  m  =  0  to  b,  which, 

r=0 

whv,n  n  is  large  may  be  replaced,  with  exponentially  small  error,  by 

00 

I  r  e  .  Solving  the  equations  and  simplifying  leads  finally  to 

r-0 


k  =  -  log^Q 


di  “  '  I  -  qi  -  V5  - 

di 

e  _  e_ _ 


1  q2  d1  kbl 

da  ■  -Vs  -  +  r  *  Vi +  kW  +  it 


3q< 


-  ib2(i  -  1)  -  J  |  ((d1+k)2-d l)(^  .  _i) 


-i[(dl+k)5-d3)(_i.l)  -^((d^k)4^) 

q2  di 

el  =  d2  "  2 -  2  "  dlql  "  kbl 


Table  2.1  gives  the  numerical  values  of  d^  and  correct  to 

k  and  3  significant  figures,  respectively,  for  a  =  0.05  and  0.01 
for  the  standard  procedure  P  and  procedures  in  which  an  initial  set  of 
m  >  2  observations  are  taken. 
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p 


m  =  2 


m  >  2 


dl 

d2 

dl 

d2 

dl 

d2 

-3.080 

0.6? 

-2.080 

-U.97 

-2.080 

-0.25 

-3.885 

1.69 

-2.885 

-it. 86 

-2,885 

0.77 

Table  2.1 


We  will  now  derive  asymptotic  expansions  for  E0(n).  Equation 
(1.7)  may  be  written  «s  follows: 


n-1  rb 


Ea(N)  =  n  -  l 


n-r 


,  a  <  9  <  a  . 


r=0  e 


n-r  n-1  —  n 


Thus,  if  Q  =  a  -x,  0  <  x  <  a  -a  , 
’  n  —  n  n-1 


n-1  rb 

E  (N)  =  n  -  T  - ^ - 

6  f  \n-r 

r=0  (a  -x) 


(2.9) 


From  (2.5) 


d  -kx  d 

8n_x  =  k(1  +  “nr~ +  ~2 +---  } 

n 


(2.10) 


Substituting  this  expansion  and  the  expansion  (2.6)  for  b^  into  (2.9), 
taking  the  sum  from  r  -  0  to  «  and  simplifying  leads  to 
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W  1  ^  2 

E.;(N)  -  n-(kb1+q1e  )  t  -  ([e^  +  ~  +  73-  (d^kx) 

+  q2(di~kx)  je^  +  kb^(d^-kx)-k^b^ )  +  0(-|-)  for  9  §  a^-x, 

n 

0  <  x  <  a  -a  .  .  (2.11) 

-  n  n-1  ' 

We  may  also  expand  E,(N)  in  powers  of  i  rather  than  -  if  0 

u  u  n 

and  n  are  both  large.  In  this  case,  if  B  -  a^  then  n  =  k@-d^  +  O(^) 
and  hence,  using  (2.11)  with  x  =  0  we  have 

£.,(!■;)  =  k(6  +  |)  .  b1C(|  -  l)-k}  +  0(i)  (2.12) 

For  assessing  the  efficiency  of  the  sequential  procedures  discussed 
In  this  paper,  a  convenient  standard  is  provided  by  the  optimal  fixed 
sample  size  procedure  \  for  6  >  1,  u(6)  =  a — —  is  the  least  n 

iog(i  -  h 

A  A  V 

for  which  P  (X  <  6  <  X  +1)  >  1-a.  Since  k  =  log  l/a,  M-(@)  = 
t-  n  —  n 

kfl  -  h)  +  0(i).  Thus,  using  (2.12),  lim  =  1  so  that  the 

sequential  procedures  may  be  said  to  be  asymptotically  100  percent 

efficient,  relative  the  optimal  fixed  sample  size  procedure. 

We  will  now  derive  esymptotin  expansions  for  Ed(N)  when  the  ob- 

serva! ions  are  taken  in  groups  of  m.  It  is  sufficient  to  consider 

only  the  case  in  which  n  is  a  multiple  of  m,  since  if  it  is  not, 

a(m)  _  a(m)  where  x  is  the  largest  integer  smaller  then  —  .  Hence, 
u  xm  m 

let  n  be  a  multiple  of  m,  say  n  -  zm.  Then,  using  (1.8) 
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Ep(N) 


z-1  rmb^m^ 
r  n-rm _ 

rtb  {aM-x)n~Tm 
v  n 


for  e  = 


a(m)-x,  0  <x  <a(ra)-a(m) 
n  -  n  n-m 


(2.13) 


Expanding  the  right  hand  side  of  (2.13)  in  powers  of  n  leads  to  terms 

2  z  -1 

of  higher  order  than  n~  involving  the  series  £  (rm)Je"’rm, 

r=0 

J  =  1*2,3*  However,  for  fixed  m  and  large  z,  these  series  may  be 

replaced,  with  exponentially  small  error,  by  T  (rm)Je"  . 

r=0 

We  now  define  ft  sennenre  «(®)  —  f  V 


We  now  define  a  sequence  [q:  '},  where  q:  '  =  £  (rm)Je’r  , 

J  J  m  1  6  '  r=0 
,  s.  (e-l)e  1 

j  =  0,1,2,...  .  Thus,  for  example,  q^m  =  -  and 

0  /  m  _  x 

(e  -1) 

_(m)  m(e-l)em*1  „  .  ,  . 

q  =  — ^ —  .  Hence  we  are  led  to 

1  (era-l)2 

Am) 

=  n-e1“(q(">)  +  i[eiq(”)+!|_  -  *,,£»>  +|  (Vkx)2q« 

+  (d1-kx)q|mh  +  0(-|))  for  m  >  2,  0  =  a(mhx  0  <x  <a^mha^m) 

L  d  d  n  —  n  n-m 


and  for  m  =  2 


E0(N)  =  2z-elo'(q^)+5i[e1qj2)+^|—  -  d£q^2)  +  |(d1-kx)2q;[2)+(d1-kx)q^ 


+  k2b*2)e'toJ  +  0(-|)  for  0  =  a^2)-x,  o  <  x  <  aj;2)-aj^) 


2z  2(z-l)  • 
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In  the  tables  to  follow,  when  a  number  is  given  in  brackets,  it 
is  the  exponent  to  the  base  10,  of  the  number  immediately  preceding  it} 
e.g.  2.101(4)  «  21,010. 


n 


£l 

0.05 

0.01 

1 

2.632(-2) 

1.010(-2) 

zero 

zero 

1.952(-2) 

l.03l(-3) 

4.65l(-2) 

2.944(-3) 

2.197(-1) 

8.369(-3) 

1.080 

2.964(-2) 

6.714 

1.210(-1) 

4.706(1) 

5.697(-l) 

3.773(2) 

3.016 

3.361(3) 

1.776(1) 

) 

3.307(4) 

1.150(2) 

Tteble  2:  Values  of  b 

n 
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3.  Comments, 


Graybill  and  Connell  [2]  have  proposed  a  two-stage  sequential  pro¬ 
cedure  for  the  problem  considered  in  this  paper,  in  which  the  informa¬ 
tion  of  the  first  sample  is  ignored  once  the  size  of  the  second  sample 
is  determined.  However,  in  practice  this  approach  is  not  likely  to  be 
acceptable.  A  solution  making  use  of  information  from  the  entiie 
sample  would  seem  preferable.  The  author  has  worked  out  details  of  a 
two-stage  procedure  based  on  the  largest  observation.  This  procedure 
has  optimality  properties  similar  to  those  of  the  procedure  of  section 
1.  This  work,  together  with  details  of  unbiased  point  estimation  of 
0  based  on  the  procedure  of  section  1  will  appear  in  a  later  publication. 

The  author  is  indebted  to  E.  W.  Bowen  for  proposing  these  problems 
and  for  many  helpful  discussions. 
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